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^JjMODSlM W0*LD 


ACT-R Cognitive Architectures 


• Computational 
implementation of 
unified theory of 
cognition 

• Commitment to task- 
invariant mechanisms 

• Modular organization 

• Limited capacity 

• Hybrid symbolic 
statistical processes 
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Motivations and Applications 

• Philosophy: Unified understanding of the mind. 

• Psychology: Account for experimental data. 

• Education: Provide cognitive models for 
intelligent tutoring systems and other learning 
environments. 

• Human Computer Interaction: Evaluate 
artifacts and help in their design. 

• Computer Generated Forces: Provide cognitive 
agents to inhabit training environments & games. 

• Neuroscience: Provide a framework for 
interpreting data from brain imaging. 


;a8S5S5Jgf' ■ Goals 

• Enable the implementation of more complex 
ACT-R models 

• Scale up cognitive models to simulate learning 
/ adaptation in communities 

(e g., about 1,000 models in parallel) 

• Treat models as hard claims 

- Evaluate each specified component against data 

- Underspecify the rest and fit free parameters 
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The Argument 


MODSIM HOILD 

rfi-nwnfra | firm 

• Constraints: Architectural advances require 
further constraints 

• Scaling it up: Complex tasks, broad coverage 
of behavior (e.g., linguistic), use of 
microstrategies and predictive modeling may 
serve to motivate further architectural 
constraints 

• Difficulties: ACT-R is heavily constrained 
already, and models are difficult to develop, 
reuse and exchange 


Control Structure 

A flow-chart describes an 
algorithm (or a cognitive 
strategy) 

Decision-making points 
and states 

Not easy to reuse: it fails 
to capture 
generalizations 

Computer Science: 
pre-Object Orientation, 
pre-Functional 
Programming 
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IF THEN 


Production Rule System 
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The Argument 

• Constraints: Architectural advances require further 
constraints 

• Scaling it up: Complex tasks, broad coverage of 
behavior (e.g., linguistic), use of microstrategies and 
predictive modeling may serve to motivate further 
architectural constraints 

• Difficulties: ACT-R is heavily constrained already, and 
models are difficult to develop, reuse and exchange 

• We need to produce models at a higher abstraction 
level 

- However, we’d like to leverage successful cognitive 
modules, describing memory retention, cue-based 
retrieval, routinization, reinforcement learning 




MODilM WOULD 


Cognitive Strategy 
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Priming Model 




MDOIIM WOllO 


Crucial request of a chunk from declarative memory 


* Only a small portion of the 
model explains the behavioral 
data at hand 

• The rest explains that the task 
can be accomplished in 
principle with a parallel 
architecture and with specific 
cognitive representations 
(chunk types) 





MOD&IM MOtLD 

| 

even sum: 

eir. 1 

aumloop t 

add. 1 

accumulator 

oubq 


bne 


mule 


rts 


Production Systems vs. 
assembly language 

01 jSaro-out 

•Accumulator 
DO , D 1 ? Add current 

? counter value to 

#1, DO ; Dec reme nt 

j counter by one 
sumloop /until It 

/reaches xero 

#2,01 i Double sun to account 
/for even numbers 
; Return 
i to caller 



-1990 
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The Argument 




MDOIIM WOllO 


• Constraints: Architectural advances require further 
constraints 

• Scaling it up: Complex tasks, broad coverage of behavior 
(e.g., linguistic), use of microstrategies and predictive 
modeling may serve to motivate further architectural 
constraints 

• Difficulties: ACT-R is heavily constrained already, and 
models are difficult to develop, reuse and exchange 

• Abstraction: To implement those, we need to produce 
models at a higher abstraction level 

• Underspecification is the key to focus on verifiable 
claims, and to avoid overfitting by fitting free 
parameters to data 


TJmodsiu woiib Underspecified Models 

c ■ ■■ Vsnce a. l>ec ■ 


specify: 

non-deferministic 
explains empirical variance 
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Buffers as interfaces and 

a term of working memory 

(e g Goal, Reme^al buffers) 


Perceptuaf/Motor/etc 

Modules 


Acliv^a^n 


ratnlh^J requests 

wjrfaqjfo 

chunk tsmbtates 


Conloxtuollfnilen of rolhovola via base Icvol activation 
(recency frequency) and spreading KtMton (cues) Siochastrcrty wa noise 
Learning upon presentations (bage-levet) and co-pfesenl|itions (ewes) 



Buffers as intortacas and 
a form of working memory 
(e g., Goal* Retrieval bulfors) 


Mdoii 

CaHw 


Percept ual/Moio r/etc 
Modules 


&m spread 


enunk lempwM 


isp fRrppSPW*feiyterTiory 

(if-then rules) 


Declarative Memory 
(Storage and retrieval of chunks) 
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ACT-UP 


WOULD 

£ U CflrVrcf t tw 

• A stand-alone system on the basis of Common 
Lisp 

• targets an audience that can write simple Lisp 
programs (unlike, e.g., CogTool) 

• Toolbox approach to ACT-R 

- light-weight: it’s a Lisp library 

- does not produce production rules (ACT- 
R/Lisa, ACT-Simple, CogTool) 

• Not aimed at implementing all constraints of 
ACT-R 6 (unlike Java ACT-R, Python ACT-R) 


WOtlD 

r Hr ‘«sj 

Declarative 

Memory 

• 'define-chunk-type’ 

* types are optional 

• 'make-count-order’ 

• ' learn-chunk’ 

• 'defrule’ 

• ‘retrieve-chunk’ 

• 'count-order-second 


; ; ACT -R parmettrs 

<setq "IP ,05) 
(setq "rt* -1) 

ACT-UP Code 

; ; ; ; Opt \ rung cr*nk tyfw 


rdefi rw -chunk count -order first second) 
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f % " Conloronce & Expo 


ACT-UP is notACT-R 6 ... 

• ACT-UP Interface is synchronous 

- Serial execution 

- Deterministic strategies defined as programs 

• Parallelism (e.g., perceptual/motor modules) 
possible [not implemented] 

• Non-deterministic rule choice is possible 

- Reinforcement-learning as in ACT-R 6 


a 


MODSIM WORLD 

Conference & Expo 


PM / Utility learning 


'choose-coin’ 
calls either decide- 
heads 

or 'decide-tails’ 
'assign-reward’ 
reinforces 
the decision 

Exact production rules 
are underspecified, 

- but decision-making 
point is explicit 

Choice model 
replicates ACT-R and 
empirical results 


;; Experimental environment 
(defun toss-coin () 

(if (< (random 1.0) .9) 'heads ’tails)) 

; ; The Model 

;;;; Rules that return the choice as symbol heads or tails 

(detrule decide-tails () 

: group choose-coin 
tails) 


(defrule decide-heads () 
! group choose-coin 
i heads) 
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Debugging 




MO&tiM wono 

Corfeprs* A bi» 


(defrule coun t -model (orgl ar§2) 

Taunt from ARG1 ta ARG1 , 

ARC1 is the storting point and ARG2 is the ending point, 

Each increment is 1 unit*" 

(speak argl) 

(if (not (eq argl argZ}) 

(let <(p (debug -detail (retrieve-chunk (list : chunk -type ’count -order 

: first argl))))) 

Cif P 

(count -mod el (count -order- second p) arg2») 

;; else return end point 

arg2)) 


Jte&vtz* Debugging 


CL -USER- fttobug-detoU (doit 1)> 

wake mutch- chunk (make -TYPE*): Ho such dunk in pH Returning nn thunk £not In W) of now LOSE 
Presentation of chunk LOSE (Npi file t-?Z?6i.2fi. M: «0ELSa4i6. L-O. 

Ir^Umly trtcdtlnl chunk of name LOST 

reputation of chunk LOST CMP- NR U717GL.Z6. H; HO0EL5ZHW, I-* 
tmrilirttly r rent I no chunk erf now Bi AWtt 

Prestntdtlon of chunk BLANK (W; WtL W*7W,S» M: WDELHH36, t*7Z7fil 3ffi 

woke eu uh- chunk (m*e TYP£*V: Ha such clunk in EH, Returning ti« chunk { tm in UHJ of ww HAVE 

Pretwrtfltian af Chunk HAW (HP; NIL t-727fil.4*S M: *X*L5 mTH34. *-72711.44$ 

invalid tty treating thunk of rone HAD 

prevent at ion of thunk HAD {**" NJL i-7Z7*I-44S Hr H»L5Zi4J&, t-?Z?&l.*45. 

0rw5 past T1HSE HOO€L with !•# Botching rules, choosing rule PTH30EL (unlit* 1- W I I386 ) 

firtHO FOB* -FAST TENSE With Jrff notching rules. Choosing rule STRATEGY - WITHOUT ANALOGY (Utility S,ZZS*7) 

rwtriwee'ChwUtt 

me: fOOOt rm »ASTUm VERS GET} 
cuts: NIL 
pwrt NIL 

filter** t watching chunks 
rwtrteufrrt arm- net n* ft witrnn) rfim** 

NIL 

Assi jilng r e wo r d S.9 

Manning reward S tSllZS to STRATEGY - H1TKJUT - ANALOGY STRATEGY-*) Til ANALOGY rewaim t»S| regular r*ul* in grow fW-PAST-TLNSE 

A^kl jhing reward N O to PTHOKL. Best realtor rule cronq alternatives in pro# PAST - Tf NSf NODE L l 1 

Nil 

a -US ERr | 
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" Conference & Expo 


Implemented Models 

• 10 Classic models implemented: 

- count, addition, siegler, zbrodoff, paired, fan, sticks, 
semantic, choice, past-tense 


* past-tense not yet complete 


a 


MODSIM WORLD 

Conference & Expo 


Efficiency 

• Sentence production (syntactic priming) model 

- 30 productions in ACT-R, 720 lines of code 

- 82 lines of code in ACT-UP (3 work-days) 

- ACT-R 6: 14 sentences/second 

- ACT-UP: 380 sentences/second 
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" Conference & Expo 


Scalability 

• Language evolution model 

- Simulates domain vocabulary emergence 
(ICCM 2009, JCSR 1010) 

- 40 production rules in ACT-R (could not prototype) 

- 8 participants interacting in communities 

• In larger community networks: 1000 agents, 84M interactions 
(about 1 minute sim. time each), 37 CPU hours 


a 


MODSIM WORLD 

Conference & E*po 


Rapid prototyping/Reuse 


• Dynamic Stocks&Flows model (JAGI2010) 

- Competition entry, model written in < 1 person-month 

- Instance-based learning (IBL, Gonzales&Lebiere 
2003) 

- Blending (Wallach&Lebiere 2003) 

- free parameters (timing) estimated from example 
data 

- Model generalized to novel conditions 
• (.... NOT. but it did so better than others.) 

• Same IBL/blending micro-strategy was re-used directly 
in a Lemonade Stand Game entry to a 2009 
competition (BRIMS 2010) 
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Drawbacks 


fl 


MDOIIM WOllO 

'ifrlvfSt 4 to 


• Less established code-base than ACT-R 6 

• Lisp 

• Lack of architectural timing predictions from 
rule matching 

• Lack of parallelism (planned: fall 2010) 

• lack of perception/motor modules 

- Will be available in ACT/Simple-style interface 
(Salvucci&Lee 2003) 


JmODSIH WOtLD 

J Cflrrfwie* & L*pc 

Beta-Test 

• Limited Release of ACT-UP test version 

- comes with 10 example models 

- 4 tutorials (paralleling the ACT-R 6 ones) 

- Full API documentation plus How-do-1,, . document 

• Testing period: Fall 2010 

• Task: implement 1-2 models of your own 

• Review letter requested (journal-review style) 
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